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(jdv:’ 

MEMORANDUM /0R: Assistant Deputy Director for Intelligence 

SUBJECT : Procedures foe Validation cf Evaluations of 

Clandestine Service?. Reporting 



REFERENCE 


: Your memorandum cf ?4 January 1968, f ame 
subject 


1. I have considered your memorandum carefully. I share, cf 
course, your desire to ensure that all evaluations, including those rendered 
orally, ere valid. The question is one cf means. 

2. Before discussing alternative proposals, I should ll.<e to list 
what seem to me the essential criteria for any procedure. 

a. It should produce valid evaluations. 

b. When necessary. It should produce speedy evaluations. 

c. When necessary, it should produce detailed and thorough 
evaluations. 

d. It should be simple, understandable, and as little of a 
burden on anybody as possible. 


e. It should allocate responsibility appropriately. 


3. Since you indicate that you are speaking for the Director a to cf 
Science and Technology as well as the Directorate of Intelligence, I shall 
refer to them together for convenience as the intelligence Directorates. 


4. At present, most Clandestine Sen/Ices requests for evaluations 
by the intelligence Directorates, including a substantial proportion cf 
requests in support of the assessments program cf the FI Staff, are made 
in writing through the Information Requirements Staff, and the resultant 
evaluations are received through the same channel, having presumably 
been validated In accordance with your procedures, t he question you 
raise concerns only those evaluations which are obtained by the FI Staff 
through the second method cf interviewing analysts. 
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5, 'Hie problem as you state it is that the present arrangement 
relies only on analysts' views and does not provide for the balanced and 

authoritative validation that we are now demanding for other collection 
guidance and requirements for collection by human sources. " 

6, It is necessary to understand the purpose and methods of the 

FI assessments program. It is not designed as a requirements or collection 
guidance program. Its purpose is not to obtain new requirements but to 
evaluate reporting against previously authorized requirements. It is 
concerned with the information product of stations, operations, and sources. 
Specific reports are what is discussed with analysts. It is true that analysts 
sometimes volunteer their views on requirements matters. I shall return to 
this point later. 

7. Most FI assessments deal with individual sources or projects. 

A smaller number deal with broad subjects such as the production of an 
entire station, but almost invariably this also involves specific treatment 
of projects and sources. Evaluations from consumer offices — including 
DIA and State/INR as well as CIA consumers— are only one form of input 
to these studies. These evaluations of reports are one basis for the final 
FI evaluation of source production . " 

8. As I have said, some evaluations of groups of reports needed 
for FI assessments are obtained in writing through formal channels. But 
in many cases interviews are vastly preferable, for one or both of the 
following reasons: 

a. The need for speed {almost always present when the 
occasion is a project renewal action) 


b. The fact that when there are many reports, a number of 
sources, or various facets of reporting to be covered, an inter- 
view accomplishes far more infer less time than any other 
method. The analyst is seeing the reports for the second time 
(having read them when they were published). He can quickly 
refresh his memory of them, and by mutual questioning the 
points at issue can be isolated and treated. To attempt the same 
thing in writing would be burdensome to the analyst, involve 
mountains of paper, and result in much less responsive evaluations. 

9. To return now to the problem you have raised, I should like to 
comment briefly on the two alternative solutions you have described and to 
offer two more for your consideration. 
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10. I agree with you that your first alternative — to "require the 
FI Staff to request the Information Requirements Staff to obtain such 
validated assessments through the chain of command of the substantive 
offices involved 1 '— should be avoided if at all possible. My principal 
reasons appear in the foregoing paragraph. Si effect, this procedure 
would mean that the Clandestine Services would lack the benefit off timely 
and appropriate DDI/DD6&T evaluations of much of our production, and 
would have to rely exclusively on the remaining available inputs to our 
assessments program. 

11. With respect to your second and preferred alternative, 
described in your paragraph 4, I regret that it seems to me to Ignore 
key aspects of the problem, possibly because the Clandestine Services* 
problem had not been made perfectly clear to you. Briefly, this procedure 
would require FI Staff to interview the analyst, wit© down the analyst’s 
views, and forward these views to the Information Requirements Staff, 
which would obtain validation from the "appropriate authorities, " who, I 
think it is fair to say, would in many cases be the first- and second- echelon 
supervisors off the original analyst. Finally, the Information Requirements 
Staff would transmit th® validated paper to the FI Staff. 


a. My principal objection to this procedure Is that it 
interposes the FI Staff between the DDI or D3DS&T analyst 
and his superiors in the production offices, as well as 
between the production offices and the Information Require- 
ments Staff. Thi3 is not, In my judgment, a proper function 
for the FI Staff. It should not be necessary for the FI Staff 
to enter the intelligence Directorates at two different times 
and two different points in order to obtain one evaluation. 


b. Your paragraph 4. b is based on the assumption that 
the FI Staff drafts its assessment studies in such form that 
a section off the draft could appropriately be circulated for 
DDI/DDS&T review. For various reasons related to the 
purpose and organization erf the studies this is seldom the 
case, and your proposal would thus necessitate the creation 
of a separate document solely for validation purposes. This 
would be time-consuming. 


c. Inherent in your proposal is the assumption that no 
use would be made eff the analyst* s evaluation until it had been 
validated. Any contrary course would negate the purpose of 
validation. But to wait for the validated version would in many 
cases be to miss the boat on, for instance, a project renewal. 
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d. In view of the nature of the oral evaluations received, 
tt is hard to see how they could be meaningfully validated, except 
by someone who went over the same 26 or 75 reports read by the 
analyst. I doubt that you had such a chore in mind for your 
validating officers. In any event I would not wish reports grouped 
by source to go through the mails. 

g. In short, referring to the criteria in my second paragraph, 
this method might produce valid evaluations, but often too late for 
use. E is not simple; it imposes an extra workload on both sides 
of the house; and it does not allocate responsibility appropriately. 

12. I should like to suggest two other alternatives for your 
consideration. Both are designed to meet your problem as well as mine. 


a. The first is to have the validating authority sit with the 
analyst and the FI interviewer, and validate the evaluations on 
the spot. In most cases this would be the analyst's division 
chief or other supervisor. (Indeed, the "analyst” Interviewed 
by the FI Staff sometimes is a division chief. ) There are not an 
enormous number of interviews - -there were 45 in the last half 
of 1907* -and they do not fall heavily on any one area. I am 
convinced that the occasional hour or two spent in this way by 
cm of your ranking officers would be no burden at all, compared 
with the man hours, paperwork, and total elapsed time under 
the procedure previously discussed. Furthermore, these senior 
officers will be in a position to report to you the exact nature 
and thrust of these meetings. 1 would certainly have no objection 
if it were desired to have a representative of the Information 
Requirements Staff sit in as well. 

b. A final alternative, which I would consider acceptable 
though less desirable than the preceding one, would be based 
on an agreed -distinction between (1) evaluation of reporting 
against existing requirements, and ( 2 ) collection guidance, 
requirements, ' gaps, or ony other statements by analysts 
which might be intended or understood to bear on what the 
Clandestine Services try to collect, or how the collection effort 
should be apportioned. Evaluations of reporting would be used 
by the FI Staff without further validation. The second category 
would not be used without first confirming through the Information 
Requirements Staff that it did constitute validated guidance. This, 
I think, would achieve the purpose of validation without bogging 
down the evaluation program. 
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13. I suggest that you establish the validation procedure outlined 
in paragraph 12, a— on a trial basis, if you prefer. If this procedure is 
not acceptable to you, I suggest the alternative outlined in paragraph 12.b. 


jij -Ifeiitas H. Katei&sfts! 

Thornes H. Kara mes sines 
Deputy Director for Plans 


cc: DDCI 
DDS&T 
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